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Let  (CiT)  be  a  partitioned  zero  mean  normal  random  vector  with 
A  B  * 

covariance  matrix  (  )  where  cov(^)  =  A  and  cov(ii)  =  C, 

O  (j 

with  cov(  )  meaning  the  covariance  matrix  of  the  random  vector 
enclosed.  The  usual  way  of  getting  the  conditional  mean  and  covariance 
matrix  of  given  that  H  =  p,  is  to  divide  the  joint  density  of 

^  and  »i  by  that  of  f).  The  following  is  an  alternative  method  which 
is  more  general,  in  that  it  does  not  require  that  ^  and  q  have  a 
joint  density,  or  even  that  r|  have  a  density. 

This  is  the  result  we  want  to  prove:  The  conditional  mean  and 
covariance  of  given  that  n  =  P>  bltb 

E(^h  =  p)  =  pc'^B,  cov{{;|n  =  p)  =  A  -  b'c'^'b 

where  is  the  pseudoinverse  of  C,  that  is ,  if  C  =  T'T  with 

T  r  X  m  of  rank  r,  then  =  T'(TT')~^*  If  exists,  then 

C"*^  =  C  The  pseudoinverse  of  a  symmetric  matrix,  although  perhaps 
not  under  that  name,  is  well  known  and  has  been  used  in  statistics 
for  some  time.  For  a  recent  discussion  and  references,  see  [l]. 

Let  E  =  T'{TT')~^T  ~  =  CC^  be  the  projector  of  the 

row  space  of  C.  Note  that  CE  =  C,  and  hence  for  any  matrix  F 
whose  rows  are  in  the  row  space  of  C,  FE  =  F.  In  particular,  B' 
in  the  covariance  matrix  above  satisfies  B'E  =  B',  since  the  rows 
of  B*  are  in  the  row  space  of  C.  (The  general  covariance  matrix 
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S'  S ' S  S 'U 

may  be  assvuned  to  have  the  form  (y,)(SU)  =  (yig  U'U^  ’ 

space  of  S'U  lies  in  the  row  space  of  U,  which  has  the  same  row 

space  as  U'U.) 

We  will  derive  the  formulas  for  conditional  mean  eind  covariance 

of  given  1  =  Pi  by  representing  ^  in  such  a  way  that  it  is 

obvious  what  conditioning  on  tj  means.  We  need  only  the  fact  that 

the  sum  of  two  normal  random  vectors  is  normal,  and  that  if  ^  has 

covariance  C,  then  qM  has  covariance  M'CM.  Let  C  be  a  zero 

mean  normal  random  vector  which  is  independent  of  rj  and  which  has 

covariance  A  -  (This  is  a  valid  covariance  matrix,  for  example, 

that  of  ^  -  fiC^B.)  Then  ^  =  C  +  iC^B  is  our  representation  for 

since  the  covariance  matrix  of  (Cjl)  =  (C>l)(  ^  is 

C  B  I 

Since  and  q  are  independent,  it  is  obvious  that  the 
conditional  mean  of  C  +  iC^B,  given  that  1  =  p,  is  pC^B,  and 
that  the  conditional  covariance  is  that  of  C»  Hence  our  general 
result;  If  is  a  zero  mean  normal  vector  with  cov(^,ri)  =  ((,  „  ), 

cov(^)  =  A,  and  cov(ti)  =  C,  then  the  expected  value  and  covariance 
of  given  that  1  =  p,  are 

E(^h  =  P)  =  pc'^B,  cov(^h  =  P)  =  A  -  B'C'^B 

where  is  the  pseudoinverse  of  C,  that  is ,  ^ 

exists ,  otherwise ,  if  C  =  T'T  with  T  r  x  m  of  rank  r,  then 
C+  =  t'(TT')“^T. 


3 


REFERENCE 

[1]  Greville,  T.  N.  E.  'Hie  pseudoinverse  of  a  rectangular  or  singular 
matrix  and  its  application  to  the  solution  of  systems  of  linear 
equations.  SIAM  Review,  Vol.  1,  No.  1,  January  1959,  p.  38-43* 


